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Abstract 

A situation calculus is presented that provides a solution to the frame problem for hierarchical 
situations, that is, situations that have a modular structure in which parts of the situation 
behave in a relatively independent manner. This situation calculus is given in a relational, 
functional, and modal logic form. Each form permits both a single level hierarchy or a multiple 
level hierarchy, giving six versions of the formalism in all, and a number of sub- versions of these. 
For multiple level hierarchies, it is possible to give equations between parts of the situation 
to impose additional structure on the problem. This approach is compared to others in the 
literature. 
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1 Introduction 

The situation calculus formalism permits reasoning about properties of situations that result from 
a given situation by sequences of actions |MH69 . A problem with this formalism is the necessity 
to include a large number of frame axioms that express the fact that actions do not influence many 
properties of a situation (for example, if you walk in a room, the color of the wall typically does 
not change). Non-monotonic logic is one approach for handling such frame axioms, by assuming 
that properties stay the same unless they can be proved to change, but this logic has additional 
complexity compared to classical logic. Reiter |Rei91| proposed an approach to the frame problem 
in first-order logic that avoids the need to specify all of the frame axioms. In this paper another 
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approach to the frame problem based on aspects is presented. An aspect is essentially a relationship 
between a situation and one of its component parts. Each action and fluent (property of a situation) 
has an aspect, indicating which component of the situation the aspect or fluent refers to, and if the 
aspects satisfy a certain specified relation, it follows that the action does not influence the fluent. For 
example, if an action and fluent have different aspects, this can indicate that the action influences a 
different component of the situation than the fluent refers to. Using aspects to specify frame axioms 
can reduce their complexity, because many actions and fluents can have the same aspect. In addition 
to the use of aspects for specifying frame axioms, a number of approaches for deriving aspects of 
actions and fluents from more fundamental properties of a situation are also given. 

2 Aspects 

All methods for formalizing aspects considered here have the following general features: Actions 
modify situations, which are denoted by the variables s, t, and u. A situation is assumed to be 
composed of relatively independent parts and each part is called an aspect of the situation. Thus if 
a building has four rooms, each room could be considered an aspect of the building, because many 
actions will only influence one room of the building. In the traditional situation calculus, a situation 
s represents the entire world. In the aspect formalism, a situation s can represent just a portion of 
the world, for example, a room of a building. If a is an aspect, then R a (s, t) indicates that situation 
t is an a aspect of situation s. If t is unique, it may be denoted by f a (s). The symbol a denotes an 
action, and a(s) denotes the situation that results when action a is performed in situation s. This 
is an abbreviation for do(a,s), for example, do(drop(x), s). Also, a may have preconditions, but it 
is not necessary to consider them here. A fluent is a relation or predicate that can be true or false 
in a situation. The symbols p and q denote fluents. The notation p(s) indicates that fluent p is true 
in situation s. This is an abbreviation for holds(p,s), for example, holds(at(x,y), s). In the aspect 
formalism, some fluents may be properties of a portion of the world and others may not. If fluent p 
is not a property of the situation s, because p refers to something that is outside of the portion of 
the world modeled by s, then p(s) is undefined. (For our purposes, p(s) can have an arbitrary truth 
value in this case.) Similary, if an action a does not refer to the portion of the world modeled by s, 
then a(s) is undefined. Actions and fluents can have aspects, indicating which parts of the situation 
they influence. For example, if an action a has as aspect a room of a building, this can indicate that 
the action can only influence properties of that room. If a fluent has as aspect a room of a building, 
this can indicate that the fluent is only a property of that room. Thus if action a and fluent p 
have different aspects, then performing a will not affect p. The symbols on and denote aspects of 
fluents and actions, respectively, and are drawn from universes A\ and A2 of objects, respectively. 
Thus cti 6 A\ and £ A^. Often A\ — A^. For a fluent p, p : a indicates that p has aspect a. 
For an action a, a : j3 indicates that action a has aspect (3. Theoretically, a fluent or action could 
have more than one aspect, but the following discussion assumes that aspects of fluents and actions 
are unique. However, there can be many different actions and fluents that have the same aspect. 
Therefore the number of aspects can be much smaller than the number of fluents and actions. 

For each problem domain and each formalism, it is necessary to give axioms specifying the aspects 
of fluents and actions. Let F[a,p] be the frame axiom 

Vs(p(s)=p(a(s))) (1) 
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indicating that action a does not affect fluent p. Let d(a, (3) be a non-interference property, where d 
is a predicate symbol; this property will be specified differently for each problem domain. Intuitively, 
d(a, (3) means that actions of aspect (3 do not influence fluents of aspect a. A typical non-interference 
specification would be (a ^ (3) D d(a,[3). For example, an action a and a fluent p that correspond 
to distinct rooms of a building would not interact. It is also possible to let aspects of fluents be 
elements of some set T and let aspects of actions be sets of elements from T Thus A\ = T and 
A 2 = 1 r . Then the non-interference specification could be a ^ (3 D d(a,[3). For example, an action 
a might influence two rooms r\ and r-i of a building; then its aspect might be the set {ri,^}. A 
fluent p that is only a property of room r 3 might have aspect r 3 . Because r 3 ^ {n, r 2 }, performing 
action a would not influence fluent p. Another example is a telephone call between locations x and 
y that can only influence fluents having aspect x or y. Because the number of aspects can be much 
smaller than the number of fluents and actions, the axiomatization of d can be small relative to the 
axiomatization of the entire domain. For each formalism it is necessary to show the non-interference 
axiom 



for all p, a, a, (3. If p : a and a : (3 and d(a, (3), then p and a are said to be disjoint, otherwise they 
intersect. For each version of the formalism, it is only necessary to give frame axioms for a and p 
that intersect. This can considerably reduce the effort necessary to give frame axioms. 

2.1 Sequences of Aspects 

In formalisms based on sequences, actions and fluents have sequences of aspects instead of single 
aspects. The notation a denotes a sequence of aspects, that is, ot\, . . . , a n . The sequences of aspects 
may have different lengths for different actions and fluents. For this formalism, one has d(a, (3) for 
the non-interference property. The non-interference axiom becomes 



for all p,a,a,[3. If p : a and a : (3 and d(a,/3), then p and a are said to be disjoint, otherwise p 
and a intersect, as before. A typical axiom would be 3i(cti ^ Pi) D d{a,(3). Intuitively, sequences 
of aspects represent more than one level hierarchy. For example, an aspect of a country could be a 
state and an aspect of a state could be a city in the state. Some actions might influence a whole 
country, some might influence just one state, and some might influence just one city in one state. 
These would correspond to different length sequences of aspects. Another example is binary trees; a 
sequence of and 1 specifies a subtree of a binary tree, with signifying left subtree and 1 signifying 
right subtree, for example. So an empty sequence refers to the whole tree, the sequence (1,1) refers 
to the right subtree of the right subtree, et cetera. If an action a has aspect (1,1) and a fluent p 
has aspect (0,1,0) then the action can only influence the right subtree of the right subtree, while 
the fluent is a property of a different subtree. Thus one would have F[a,p\. If the action has aspect 
(1,1) and the fluent has aspect (1,1,0) then the action can influence the fluent. Longer sequences 
indicate smaller influences of an action and fewer dependencies of a fluent. 

2.2 Assuming the Non-interference Axiom 

The preceding discussion, both for aspects and sequences of aspects, is concerned with justifying 
the non-interference axiom from more basic properties. A simpler approach would be to assert the 



p : a A a : (3 A d(a, (3) D F[a,p] 



(2) 



p : a A a : (3 A d(a, (3) D F[a, p] 



(3) 
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non-interference axiom for each problem domain; then it is only necessary to assign aspects to fluents 
and actions and give axioms specifying d. Even this approach can greatly simplify the frame axioms. 
Suppose there are m fluents p±, . . . ,p m having aspect a and n actions a\, . . . , a n having aspect /?. 
Then from the non-interference axiom, the specification of d, and the assertions pi : a, 1 < i < m 
and cij : (3, I < j < n it is possible to deduce the urn frame axioms 

F[a,j,pi\, 1 < i < m, 1 < j < n (4) 

This approach requires only m + n + 2 small axioms, assuming that the specification of d requires 
only one small axiom, whereas directly specifying the ran frame axioms would require ran axioms. 
Of course, there could be other actions and fluents having other aspects (3 1 and a'. For each pair 
(a, (3) of aspects such that d(a, one obtains ran frame axioms, where there are ra fluents of aspect 
a and n actions of aspect /3. This approach essentially classifies actions and fluents and uses this 
classification to formalize general frame axioms having many specific frame axioms as consequences. 
This method alone gives an economical solution to the frame problem in some cases. 

However, the question remains as to how the non-interference axiom is justified, ft is profitable to 
consider various semantics and axiomatizations from which the non-interference axiom is derivable. 
This helps to gain insight into this axiom, as well as providing guidance concerning when the non- 
interference property should be used and how it can be formalized. 

A number of approaches to axiomatizing the non-interference property are given. In many cases, 
more than one formalism is applicable. The choice between sequential and non-sequential formalisms 
can be dictated largely by the problem structure, whether the domain has a single level or multi- 
level hierarchy. The choice between existential and universal versions of the relational formalisms 
is less clear. The functional formalisms appear simpler than the relational ones, and probably are 
preferable when they apply. They also may permit more equational reasoning. It would also be 
possible to have mixed universal and existential relational formalisms. The modal formalisms are 
equivalent to the relational ones, and the choice between them may be a matter of taste. 

2.3 Examples 

An example, the blocks world example, will illustrate some of the features of the aspect formalism, 
even though this example is not particularly well suited to aspects. There are two fluents, on(x, y) 
(block x is on block y) and clear(x) (nothing is on x). The domain consists of blocks and the 
floor. The action is move(x,y), move block x on block y, with preconditions that both x and y 
be clear. Let the aspect axioms be on(x,y) : y, clear(x) : x, on{x,z) D move(x,y) : {y, z}, and 
-i(3z)on(x, z) D move(x,y) : {y}. For simplicity, assume every block is on something. In general, 
the aspect of a block is the block it rests on (or the floor), and moving a block x has as aspect both 
its old and new locations. Let the disjointness predicate d be axiomatized by a (3 D d(a,(3). 
The general non-interference axiom, axiom [21 has the following instance: 

clear(w) : a A move(x, y) : (3 A a $ (3 A holds(clear(w), s) D holds(clear(w), do(move(x, y), s)) (5) 

From this instance and the axioms clear(w) : w, on(x,z) D move(x,y) : {z,y}, and w y A w ^ 
z z> w ^ {z,y} the following frame axiom follows. 

w^yAwj^zA on(x, z) A holds(clear(w) , s) D holds(clear(w) , do(move(x , y), s)) (6) 
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Note that the condition w ^ z of the frame axiom is not necessary, so this frame axiom is weaker 
than necessary. For problem domains with more of a hierarchical structure, frame axioms derived 
from aspects should generally be as strong as possible. Another instance of the non-interference 
axiom is the following: 

on(v, w) : a A move(x, y) : (3 A a $ (3 A holds(on(v, w), s) D holds(on(v, w), do(move(x, y), s)) (7) 
By similar reasoning, the following frame axiom follows from this instance: 

w^yAwj^zA on(x, z) A holds(on(v , to), s) D holds(on(v, w), do(move(x, y), s)) (8) 

The condition to ^ y is not necessary for this frame axiom. 

The blocks world example can be made more hierarchical by assuming that there are a number 
of rooms with blocks in each room. An action that only involves the blocks in one room, and does 
not move them to another room, will not influence any other rooms. An action that moves a block 
from one room to another can influence both rooms. For the multi-room example, the aspect of a 
block can be a sequence (cti, o^) where ct\ gives the room the block is in and cti gives the block it 
rests on. The aspects of fluents and actions are obtained from the blocks they refer to. Then d can 
be defined so that an action and fluent referring to different rooms, are disjoint. 

As another example illustrating sequences of aspects on a hierarchical domain, consider actions 
that change some of the pixels on a display and fluents that describe properties of a subset of the 
pixels. Let A\ and A2 be the set of subsets of the pixels. For each action a,j suppose that a,j : (3 
where (3 is the set of pixels modified by the action, and for each fluent pi suppose that pi : a where pj 
is a property of the set a of pixels. Then from the non-interference axiom one obtains the following: 

Pi : a A cij : (3 A a Ci j3 = <fi D F[a,j,Pi]. (9) 

Now suppose that in addition there are actions that modify the memory of a computer but not the 
display. These can be given a "memory" aspect and the display actions and fluents can be given a 
"display" aspect to indicate that they do not interfere. If there arc other objects in the room (such 
as a window and door) that arc independent of the computer then actions and fluents that refer 
to them can be given "window" and "door" aspects, and all the computer actions and fluents can 
be given a "computer" aspect, to indicate that they do not interact. Some actions may influence 
the whole room. In this way one obtains a sequence of aspects; for display actions and fluents the 
sequence is of the form (computer, display, S) where S is a set of pixels. For memory actions and 
fluents the sequence is (computer, memory ,T) where T is the set of memory cells affected by the 
action. Actions that influence the window and door would have sequences of the form (window) and 
(door), respectively. Actions that influence the whole room, such as a meteorite hitting, would have 
an empty sequence. Let the disjointness predicate d be axiomatized by d((ot\, . . . , a m ), ((3\, . . . , (3 n )) 
if for some i, on ^ (3i. Then if a±, . . . , a m is the sequence of aspects for a fluent p and (3\, . . . , (3 n is 
the sequence of aspects for an action a, the frame axiom F[a,p] follows from the non-interference 
axiom if for some i, on ^ /3j. Thus actions on the display do not influence the memory or the door or 
the window, actions on the door or window do not influence the display or the memory, but actions 
on the whole room may influence anything. 

2.4 Comparison to Other Approaches 

The most relevant comparable approach to the frame problem is that of Reiter |Kei91j . based on 
the work of Haas |Haa87| . Pednault |Ped89| . Schubert |Sch90| and Davis Dav90 . Reiter essentially 
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gives an axiom for each fluent p that says, For all actions a, if a is possible in situation s, then 
p(a(s)) holds if cither (1) a is an action that makes p true in situation s, or (2) p(s) is already true 
and a is not an action that can make p false in situation s. One such axiom is needed for each fluent, 
so the number of such axioms is equal to the number of fluents. This approach avoids the frame 
problem by focusing on actions that change fluents rather than actions that do not change fluents. 
Thus it is not necessary to give all the frame axioms F[a,p\. 

In particular, Reiter gives the following successor state axiom for each fluent R: 

Poss(a, s) D [R(do(a, s)) = 7^ (a, s) V R(s) A -17^(0, s)} (10) 

where Poss(a,s) expresses that action a is possible in situation s, 7^ (a, s) is true if action a can 
make R become true and 7^ (a, s) is true if action a can make R become false, informally speaking. 
Thus R(do(a,s)) is true if a caused R to become true or if R(s) was already true and a did not 
cause R to become false. 

A problem with Reiter's approach is that the successor state axiom for p can be very complicated, 
if many actions influence p] of course, this complexity appears to be unavoidable in any approach. 
Another problem is that it is necessary to consider all actions. Perhaps there are many actions 
that can influence p but only a small subset of them is necessary for a planning problem. In 
fact, knowledge concerning all actions that influence a fluent may not even be available. Reiter's 
approach requires that all of the actions be mentioned, whether they will be used or not. The 
traditional formalization of the frame axioms avoids this problem. The aspect approach also avoids 
this problem. But it is straightforward to modify Reiter's approach to handle unknown actions; it 
is only necessary to quantify the successor state axiom over all a in some set S of actions that is of 
interest, assuming that S is sufficient for planning or reasoning purposes. It may also be true that for 
some action a of interest one does not know its effect on a fluent R. In this case, the corresponding 
predicate 7^(0, s) or 7^ (a, s) need not be axiomatized, if the remaining axioms are sufficient for 
planning or reasoning purposes. 

In Reiter's approach, to show that R(a(s)), assuming R(s), it is necessary to demonstrate 
-17^ (a, s). This involves testing a against other actions, one by one, and verifying that a is distinct 
from all actions that can make R false. In the traditional approach, the frame axiom R(s) D R(a(s)) 
serves the purpose much more simply. Proofs in the aspect based system are also simple and in- 
tuitive. Therefore proofs are more complex in Reiter's system than in the traditional system and 
in the aspect based system. Such complex proofs may be more difficult for an automatic reasoning 
system to find. The successor state axiom in Reiter's system is compact, but unintuitive. One would 
presumably justify it by appealing to the traditional frame axioms F[a,p]. Therefore, for the sake 
of correctness, it may be preferable to use the traditional frame axioms or the aspect formalism. 
Similarly, a proof from the traditional frame axioms -F[a,p] or from axioms for aspects may be more 
convincing to a user than a proof from Reiter's successor state axiom. Of course, it is possible 
to obtain a proof using the successor state axiom and then modify it to obtain a proof from the 
traditional frame axioms. 

Reiter's approach has an extra cost, namely, the necessity to reason about equality between 
actions. The aspect formalism also has a cost, namely, the need to reason about aspects. Each 
approach may complicate the reasoning process in a different way. Reiter's definition of equality 
between actions also means that equality on actions is defined in a non-extensional way. 

Another problem with Reiter's approach, noted in Scherl and Levesque |SL93) . is that it can be 
difficult to incorporate constraints between fluents, for example, when one fluent implies another. 
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The successor state axiom essentially implies that the only way a fluent can become true is if an 
action makes it true. Lin and Reiter LR94 discuss how to overcome this by modifying the successor 
state axiom. For the aspect approach, constraints are not a problem. 

An advantage of Reiter's formalism is its conciseness. The aspect based formalism can also be 
concise, if for all but a small number of action-fluent pairs (a,p), a and p are disjoint, that is, 
p : a A a : (3 A d(a, (3). In such domains, the aspect formalism may be preferable. However, in other 
domains, the conciseness of Reiter's formalism may be preferable. In fact, the aspect based system 
is concise if the number of pairs (a, p) such that a and p intersect is not much larger than the number 
of pairs (a,p) such that F[a,p] is false, because the latter will contribute to the complexity of either 
formalism, as well as to that of the traditional formalism. 

One can combine Reiter's approach with aspects by using the successor state axiom and the 
non-interference axiom. When the non-interference axiom can be used to demonstrate F[a,p], it 
may provide simpler proofs than the successor state axiom. When F[a,p] either is false or cannot be 
shown using the non-interference axiom, the successor state axiom may be used. For this combined 
formalism it is also necessary to axiomatize d, include the non-interference axiom (or other assertions 
from which it can be derived), and specify the aspects of actions and fluents. 

A prior aspect formalism for the situation calculus was presented in |PZ97j . This formalism 
also treated hierarchical situations and defined aspects of situations. However, the axiomatization 
and semantics were different. The relation between a predicate p of situation s and a predicate q 
on an aspect of s was not considered. Also, there was no consideration of a situation variable as 
representing only one component of a situation. 

There have been many other approaches to the frame problem, but none directly related to the 
aspect formalism. Turner |Tur97j shows how to represent commonsense knowledge using default 
logic in the situation calculus. He is concerned not only with the truth of fluents but on causal- 
ity relations between them. Pirri and Reiter |PR99| formalize situations as sequences of actions 
and discuss soundness and completeness issues for planning with deterministic actions. Miller and 
Shanahan MS94 discuss narratives in the situation calculus (sequences of actions about which one 
has incomplete information). Reiter |Rei93j discusses methods to prove that certain properties are 
true in all states accessible from a given state by a sequence of actions. He discusses formalizing 
databases using the situation calculus and reasoning about their properties. Finzi, Pirri, and Reiter 
FPROO discuss open world planning and the associated theorem proving problem, using essentially 
the formalism of Reiter |Rei91| . They also convert the planning problem to a propositional problem. 
Scherl and Levesque |SL93| consider the frame problem in the context of actions that gain knowl- 
edge, such as looking up a telephone number. They also use Reiter's formalism. It is interesting 
that they use Moore's |Moo85| "possible world" formalism for knowledge, which is closely related 
to the modal aspect formalisms given below. Storr and Thielscher |ST00| give an equational for- 
mulation of the situation calculus, which is based on the work of Holldobler and Thielscher HT95 ; 
this is a different formalism from that of Reiter, and also distinct from the aspect formalism. In 
their formalism, the fluent calculus, situations are represented essentially as logical formulae, that 
is, conjunctions of fluents that are true in the situation. 

Next a variety of formalisms for justifying the non-interference axiom for aspects are presented. 
These formalisms will aid in understanding this axiom, as well as providing guidance about when 
and how this axiom may be used. 
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3 Relational Formalisms 



3.1 The Relational Formalism (Existential Version) 

In this formalism, there are relations between situations, denoted by R a where a is an aspect. The 
intuitive meaning of R a {s, t) is that the situation t is an a-aspect of situation s. Thus if s represents 
a building, t can represent one room of the building. This formalism has the following axioms: 

Vaaf3(d{a, (3) A a : (3 D (R a {s, t) = R a {a{s),t))) (11) 

\fpa(p : a D 3qVs(p(s) = 3t(q(t) A R a (s,t)))) (12) 

In words, axiom ITTl savs that a and (3 are non-interfering if the a-aspect of situation s is the same 
as the a-aspect of situation a(s) for an action a of aspect (3. For example, painting one room of a 
building does not affect the other rooms of the building. Axiom^] states that a fluent p has aspect 
a if p(s) only depends on the a aspect of situation s. The q in axiom IT2"1 is denoted by p a . For 
example, let p(s) be the property that a building is heated in situation s. If the heater is in room 
n, and q(t) specifies that the heater is on, and a is n, then p(s) = 3t(q(t) A R a (s,t)). Intuitively, 
the building is heated if the heater is on, so that an action that does not influence room r^ will not 
affect fluent p. To be more precise, because this version is existential, there can be several heaters; 
R a (s,t) means that t is one of the heaters of the building, and the building is heated if any one of 
the heaters is on. Also, if the circulation of blood through the body is a property of the heart, then 
an action that does not influence the heart will not affect the circulation. In these examples, the 
predicate q has a natural interpretation in the problem, but the formalism can be used even when 
q does not have a natural interpretation. 

Theorem 1 The non-interference axiom, axiom\^ follows from axioms \ll\ and lTH 
Proof: Suppose p : a and a : j3 and d(a, /3). From p : a and formula 1 121 

3qVs(p( s ) ee 3t(q(t) A R a (s, *))). (13) 
From a : [3, d(a,/3), and formula ITT1 

R a {s,t)=R a {a{s) 7 t)) (14) 
Therefore p(s) = 3t(q(t) A R a (s, t))) = 3t(q(t) A R a (a(s), t))) = p(a(s)). 

3.2 The Relational Formalism (Universal Version) 

This is the same as the existential version of the relational formalism except that axiom 1121 has a 
universal quantifier instead of an existential quantifier: 

Vaa(3(d(a, (3) A a : (3 D (R a {s, t) = R a {a{s),t))) (15) 

Mpa{p : a D 3q\fs(p{s) = Vt(R a (s,t) D q(t)))) (16) 

As an illustration, because this version is universal, there can be several heaters; R a {s, t) means that 
t is one of the heaters of the building, but the building is only heated (p(s)) if all of the heaters are 
on (Vt(R a (s,t) D q(t)), where q(t) means that heater t is on). 
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Theorem 2 Axiom\^ follows from tmoms 1751 and \il\ 

Proof: Suppose p : a and a : P and d(a, 0). From p : a and formula 1 161 

3qVs(p(s) ee Vi(i? a (s, t) D g(f))). (17) 
From a : /3, d(a,/3), and formula 1 151 

R a (s,t)=R a (a(s),t) (18) 
Therefore p(s) = Vt(R a (s, t) D q(t)) = Vt(R a (a(s), t) D q(t)) = p(a(s)). 

3.3 The Sequential Relational Formalism (Existential Version) 

For this formalism, R ai ,...,a„(s,t) is defined as 3u(R ai (s, u) AR a2t _„ !an (u,t) for n > 1. This formal- 
ism has the following axioms: 

\faap(d(a,P) A a : D = fl^(a(s),i))) (19) 

Vpa(p : a D 3gVs(p(s) = 3t(g(i) A i?^(s, t)))) (20) 
The q in axiom I2UI is denoted by p^- 
Theorem 3 Axiom\Q follows from axioms \ ISA and UHA 
Proof: Similar to the proof of theorem ^ 

This formalism has some additional properties relating sequences of aspects: 

Vp(p : ai . . .a n D p : ai . . .a„_i) (21) 
Intuitively, a fluent is a property of a state if it is a property of a city in the state. 

< k < m A d(ai . . . a kl Pi ■ ■ ■ Pn) D d{ot\ . . . a m , Pi ■ ■ ■ Pn) (22) 

Intuitively, an action that does not influence a state will not influence any city in the state. Also, if 
d(a, 0) is defined by 3i(ai Pi) then in addition 

< k < n A d(ai . . . a m , Pi . . . p k ) D d(ai . . . a mi Pi ■ ■ ■ Pn) (23) 

Intuitively, if an action that only influences a state does not influence city X, then an action that 
only influences a city in the state, does not influence city X. The proofs of these properties Q21I 1221 
123(1 are straightforward. 
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3.4 The Sequential Relational Formalism (Universal Version) 

This is the same as the existential version of the sequential relational formalism except that axiom 
I2UI has a universal quantifier instead of an existential quantifier: 

Vaa/?(d(5,/3) A a : D (ife(M) ee R^(a(s),t))) (24) 

Vpa(p : a D 3gVs(p(s) = Vi(ife(s, t) D q(t)))) (25) 
-Also, Rq-^ } ,(s,t) is defined as above. 
Theorem 4 Axiom\^ follows from axioms \^\ andWR 
Proof: Similar to the proof of theorem [21 

The propertiesl21landl22lhold for this formalism as well, as does |221 under the appropriate definition 
of d. 

4 Functional Formalisms 
4.1 Simple Functional Formalism 

If in the relational formalism, all R a are in fact functions, that is, for all s there is exactly one t such 
that R a (s,t), then a functional formalism can be used. In this case, t is a function of s, denoted 
f a (s). Intuitively, if the four rooms of a building correspond to four distinct aspects, then each 
aspect defines a function of the building. If an aspect of a class is an arbitrary student in the class, 
then this is not a function, so one cannot use a functional formalism. In a straightforward manner, 
one obtains the following axioms for the functional formalism. 

Vaaf3(d(a, 0) A a : $ D f a (s) = f a (a(s))) (26) 

Vpa{p : a D 3gVs(p( S ) = q(f a (s)))) (27) 

As an illustration, because this version is functional, there is just one heater; f a (s) is the heater 
of building s, and the building is heated (p(s)) if the heater is on (\/s(p(s) = q(f a (s))) where q(t) 
means that heater t is on). 

Theorem 5 Axiom\^ follows from axioms Wf\ and \£l\ 

Proof: Suppose p : a and a : j3 and d{a, /?). From p : a and formula l27l 

3qVs(p( s ) ee ?(/„(«))). (28) 
From a : (3, d{a,0), and formulaic 

f a (s) - /„(o(a)). (29) 
Therefore p(s) ee q(f a (s)) ee q(f a (a(s))) ee p(a(s)). 
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4.2 Sequential Functional Formalism 

This corresponds to the sequential relational formalism when each relation R a is a function, as 
above. One then has 

fa 1 ...On fotnfctn — 1 1 • • fa-zfai (30) 

VaaW{a, p) A a : P D /«(s) = jW(a(s))) (31) 
Vpa(p : a D 3q\/s(p( S ) = q(f-(s)))) (32) 

Theorem 6 Axiom\^ follows from axioms ^l\ andW^ 

Proof: Similar to the proof of theorem [S] 

The sequential functional formalism also has properties 1211 and 1221 and 1231 holds if d is defined 
as stated. 

5 Collective Formalisms 

The preceding formalisms help to justify the non-interference axiom. However, they do not give 
insight into the definition of d. It would be helpful to derive the axiomatization of d as well from 
more basic properties, to help to understand this predicate and to provide guidance about how to 
axiomatize it. When d{a,f3) is defined as a ^ ft the preceding discussion is sufficient, because 
it seems reasonable that actions and fluents that influence different aspects of a situation will not 
interact. However, if d(a, [3) is defined by a £" (3 or a n [3 — </>, then more justification is appropriate. 
What is the meaning of the underlying elements of these sets, in a general context, and what is the 
meaning of this particular definition of d? The following formalisms help to answer these questions. 

5.1 The Collective Relational Formalism (Existential Version) 

In this formalism, as before, there are relations between situations. Aspects of actions and fluents 
are assumed to be sets of elements of some underlying set A (for example, the students in a class, 
or the cities in a state). For each x £ A, there is a relation R x on situations. The intuitive meaning 
of R x (s,t) is that the situation t is the n-aspect of situation s. Thus if s represents a class, x can 
be an aspect corresponding to a student in the class, and t is a situation representing the properties 
of that student. Also, d{a, P) iff a n (3 — (j>. This formalism has the following axioms: 

\faxf3{x ^0Aa:(3D(R x (s,t) = R x {a{s),t)j) (33) 

Vpa(p : a D 3qVs{p{s) = (Vx £ a)3t(q x (t) A R x (s, £)))) (34) 

In words, axiom 13*3*1 savs that action a of aspect (3 can only influence the x portions of situation s for 
x £ (3. Thus if x $ P then the x portion of situation s is the same as the x portion of situation a(s). 
For example, if an action has aspect {r±, where are rooms of a building, then the action can 
only influence these rooms, so it does not influence room r3 because g 1 {ri,r2}. Axiom l3~4~l states 
that a fluent p has aspect a if p(s) only depends on the x aspects of situation s for x £ a. That is, 
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there is a predicate q such that p(s) iff for all x in a, there is some situation t that is an x aspect 
of s such that q x (t). As an example, consider a university s to be superior (p(s))if every faculty 
member x of s is above average in performance (q x (t)). Then p : a where a is the set of faculty 
members of the university. Let a be the action of increasing the student enrollment. Then a : f3 
where (3 is the set of students of the university. Axiom [331 states that action a does not influence 
any of the faculty members of the university. Axiom [2] states that the fluent p only depends on 
the faculty members; R x (s,t) if t is the situation representing faculty member x and q x (t) if t is a 
superior faculty member. From these axioms it follows that the university will still be superior if 
student enrollment increases. 

Theorem 7 The non-interference axiom, axiom\Q with d defined by a C\ /3 ^ <ft D d(pt,j3), follows 
from axioms W^ and \!Jl\ 

Proof: Suppose p : a and a : (3 and a D (3 ^ cf>. From p : a and formula 1341 

3 g Vs(p(s) = (Vz G a)3t (q x (t) A Rx(s,t))) (35) 
From a : [3 and formula 1331 

Vx(x <?/3D (R x {s, t) = R x (a{s),t))) (36) 
Therefore p(s) = (Vx € a)3t(q x (t) A R x (s,t)) = (Vi G a)3t(g x (t) A R x (a(s), <)) =p(a(s)). 

5.2 The Collective Relational Formalism (Universal Version) 

This is the same as the existential version of the relational formalism except that axiom 1341 has a 
universal quantifier instead of an existential quantifier: 

\/ax(3(x ^ f3 A a : (3 D (R x {s,t) = R x (a{s),t) j) (37) 

Vpa{p : a D 3 9 Vs(p(s) = (Vx G a)Vt(R x (s,t) D &(<)))) (38) 

This has the same intuition as the existential version, except that each student and faculty member 
corresponds to a set of situtations, all of which must have the property q x . 

Theorem 8 The non-interference axiom, axiom\^ with d defined by a R j3 ^ <f> D d{a,0), follows 
from axioms\37\ andUUft 

Proof: Suppose p : a and a : (3 and afl [3 ^ (f>. From p : a and formula 1381 

3qVs{p{s) = (Vx G a)Vt(R x (s,t) D q x (t))) (39) 
From a : [3 and formula 13 71 

Vx(x gf3D (R x (s,t) = R x (a(s),t))) (40) 
Therefore p(s) = (Vx G a)Vt(R x (s,t) D q x (t)) = (Vx G a)3t(R x (a(s),t) D q x (t)) =p(a{s)). 
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5.3 The Collective Functional Formalism 

This is analogous to the functional formalism, with collective aspects: 

Vaxf3(x £ A a : f3 D f x (s) = f x (a(s))) (41) 
Vpa(p : a D 3qVs(p(s) = (Vz G a)q x (f x (s)))) (42) 

The intuition is as above, but more natural; for every aspect x there is a unique situation f x (s) 
representing x. 

Theorem 9 Axiom\^with d defined by a n [3 ^ <j> D d{a,j3), follows from axioms \Jl\ arid ity 
Proof: Suppose p : a and a : f3 and afl (3 ^ <f>. From p : a and formula 1421 

3qVs(p(s) = (Vx e a)q x (f x (s))). (43) 

From a : (3 and formula |4*T1 

x ? p D f x (s) = f x (a(s)) (44) 
Therefore p(s) = (Vx G ^^(/^(s)) = (Vx G a)g x (/ a; (a(s))) =p(a(s)). 

It would be possible to extend the collective formalisms to sequential collective formalisms, as 
well. 



6 Modal Formalisms 

There are four more aspect-based situation calculus formalisms based on modal logic Eme90^. These 
formalisms make use of the modal operators [ ] and <>. In modal logic, [ ]A means "necessarily 
A" and <> A means "possibly A." The modal situation calculus formalisms introduce a number 
of modal operators, one for each action and fluent. Thus if a is an action, [a] A means that after 
a executes, assertion A is necessarily true. If a is an aspect, then [a] A means that in all worlds 
obtained from the current world by relation R a , assertion A is true. Also, (a) A means that in some 
world obtained from the current world by relation R a , assertion A is true. The frame axiom F(a,p) 
is expressed in the modal formalisms as the following assertion: 

P = HP (45) 

Intuitively, this means that p is true in the current world if and only if it is true in all worlds 
reachable by action a. Modal logic has the same rules as first-order logic plus additional ones; the 
only rules we need are the following: 

{XdY)d ([a]X D [a]Y). (46) 

(X D Y) D ([a\X D [a]Y). (47) 

(XdY)d ((a)X D (a)Y). (48) 

We also need the axioms 

p : a D [a](p : a) (49) 

and 

a' : (3 D [a]{a' : (3) (50) 

which say that aspects are preserved under actions. Also, if a formula X is provable (without 
assumptions), then one can deduce the formulas [a]A,[a]A, and (a)X as well. 
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6.1 Simple Modal Formalism, [] Version 

This formalism is analogous to the universal version of the relational formaliism. This formalism 
has the following axioms: 

Vaa0(d(a,0) A a : D ([a]X = [a][a]X)) (51) 
Vpa(p : a D 3q(p = [a]q)) (52) 
Theorem 10 The non-interference axiomU^ follows from formulas ^!] and Y5%L 
Proof: Suppose p : a and a : and d(a, 0). From p : a and formula [53 

3q(p = [a]q). (53) 

From a : 0, d(a, 0), and formula 15 II 

[a}X = [a][a}X (54) 

Therefore p = [a]q = [a][a]q = [a]p. The last step [a][a](7 = [a]p makes use of [a](p : a) from 
which it is derivable. The assertion [a](p : a) is derivable from the assumption p : a and axiom 

Efl 

6.2 Simple Modal Formalism, <> Version 

This formalism is analogous to the existential version of the relational formaliism. This formalism 
has the following axioms: 

Vaa0(d{a,0) A a : D {{a)X = [a](a)X)) (55) 
\fpa{p : a D 3q(p = (a)q)) (56) 
Theorem 11 The non-interference axiomX^ follows from forrmdas \5!ft and TKfk 
Proof: Suppose p : a and a : and d(a, 0). From p : a and formula 1561 

3q(p = (a)q). (57) 

From a : 0, d(a, 0), and formula 1551 

(a)X = [a](a)X (58) 

Therefore p = {a)q = [a](a)q = [a]p. The last step makes use of the assumption p : a and 
axiom a s before. 
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6.3 Sequential Modal Formalism, [ ] Version 

This formalism is analogous to the sequential universal relational formalism. Sequences of aspects 
correspond to sequences of modal operators. This formalism has the following axioms: 

[aia 2 ■ ■ ■ a„]X = [ai] [a 2 ] . . . [a n ]X (59) 

Vaa/3(d(a,/3) A a : D Qa]X = [a][a]X)) (60) 
Vpa(p : a D 3q(p = [a]q)) (61) 

Theorem 12 The non-interference axiomT^ follows from formulas foUl and J&H 

Proof: Similar to the proof of theoremllOl 

6.4 Sequential Modal Formalism, <> Version 

This formalism is analogous to the sequential existential relational formalism. This formalism has 
the following axioms: 

(aia 2 ■ ■ ■ a„)X = (ai)(a 2 ) ... (a n )X (62) 

Vaa]3(d(a,]3) Ao:^D ((a)X = [a](a)X)) (63) 

Vpa(p : a D 3q(p = (a)q)) (64) 

Theorem 13 The non-interference axiomJSl follows from formulas W^ and \U^\ 

Proof: Similar to the proof of theorem II II 

The sequential modal formalisms also have properties |2] and 123 an d 123 holds as well if d is 
defined as stated. 

Collective modal formalisms could also be defined, but it seems less natural to quantify over 
modalities. 

7 Constrained Formalisms 

The sequential formalisms are natural for domains that are tree structured, but some domains have 
a different structure. It is possible to represent these as well using constraints on aspects. For 
example, in the existential sequential relational formalism, the commutative axiom 

Vstaia 2 {R ai , a2 (s,t) = R a2t0ll (s,t)) (65) 

expresses a constraint on the structure of situations. If the set of aspects is {0, 1}, then situations 
without the commutative axiom have a tree structure, but with the commutative axiom, the structure 
becomes a mesh. A mesh structure might be more appropriate for navigating in a two-dimensional 
space, or finding locations on city streets. Of course, there are many other constraints corresponding 
to different problem structures. 

Such constraints require special care when specifying d. Suppose one specifies d by 3i{oti ^ Pi) D 
d{a,/3). Suppose a : (3 and p : a where a = (3 = (0, 1). Because there is no i such that at ^ (3i, it 
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appears that F[a,p] is not derivable. In fact, it is possible to derive F[a,p] as follows: From assertion 
^5]with a = (1, 0) and (3 = (0, 1), one obtains 

#(1,0)(M) = #(i,o) («(«)>*)• ( 66 ) 
From Rto t u(x,y) = R(i t o)(x,y) it follows that 

R (o,i)( s , t) = R(0A)(a(s), t). (67) 

From assertion |201 and p : (0, 1) it follows that 

p(s) = 3t(q(t)AR (0A) (s,t)). (68) 

From this and assertion [f2| it follows that p(s) = p(a(s)), which is F[a,p\. Thus one has F[a,p] for 
p having any of the aspects (0, 0), (0, 1), (1, 0), (1, 1), which means that action a has no effects at all, 
under a reasonable interpretation. To avoid this problem, it is necessary to specify d differently so 
that d(a,f3) unless a = (3 is derivable using commutativity. Thus in this example, d((0, 1), (1,0)) 
would not be asserted. 

It is also possible to obtain the effect of the commutative axiom in other sequential formalisms. 
In the universal sequential relational formalism, it is possible to use the same commutativity axiom. 
In the sequential functional formalism, instead of the commutative axiom one has the following: 

Vstaia 2 f ai ,u 2 = fa 2 , ai - (69) 

In the sequential modal formalism, the [ ] version, the corresponding commutative axiom is 

[ ai a 2 ]X = [a 2 ax]X (70) 

and in the sequential modal formalism, the () version, the corresponding commutative axiom is 

{aia 2 )X = {a 2 ai)X. (71) 

Of course, for a two-dimensional space, another possibility is to have aspects of the form (x, y) where 
x and y are real numbers giving x and y co-ordinates. Then it would be appropriate to specify the 
d relation using geometrical constraints of some kind. 
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